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ABSTRACT 

Recently,  Mangasarian  |l8],  | 19]  haa  discussed  the  idea  of 
solving  certain  classes  of  linear  complementarity  problems  as  linear 
programs.  The  present  paper  (l)  demonstrates  hov;  these  complemen- 
tarity problems  are  related  to  the  theory  of  polyhedral  sets  having 
least  elements  and  (f)  discusses  the  question  of  whether  the  linear 
programming  approach  can  be  recommended  for  solving  them. 


[t  is  a faii'ly  well-known  faot,  thai.  H‘  a liiieai  coniplefrienkarity 
problem  hao  u solution j then  it  has  ;i  solution  which  is  an  e::treme 
point  of  its  "feasible  set."  This  means  that  if  an  uppropi'iai.o  linear 
form  v/ere  kno\'?n  > i.e.,  one  whose  mininuim  over  the  feasibl(?  set  would 
necessarily  occur  at  a complementarity  solution,  then  biie  linear  com- 
plementarity problem  could  be  solved  as  a J.inear  prQf/;ram.  Typically, 
one  does  not  Itnow  an  appropriate  linear  form  in  advance  and  can  not 
rapidly  find  one.  But  there  are  exceptional  cases,  some  of  which  have 
been  noted  in  the  literature.  (See  [7],  [^i],  [Ibj,  [lt']>  {2('>\.)  It 
is  our  contention  that  these  linear  complementaiity  problems  solvable 
as  linear  programs  are  related  to  tVie  theory  of  polyhedral  sets  with 
least  elements.  Examp3.es  of  this  re.  tionship  are  made  explicit  by 
CoLtlc;  and  Veinott  \'A  and  by  Tfunir  [26].  Some  mmK;ri  cal  exporienen 
based  on  this  observation  is  reported  in  Cottle,  dolu'o  and  oacher  [?]. 

More  recently,  Mangasarian  [l8],  \Vj]  h'i,r.  produced  several 
additional  ex.'imp3.e.s  of  linear  complementarity  problem;,  wiio.se  solutions 
can  be  oliitained.  vi.a  linear  prograiraninp,  (wiiicii  incidentally  is  n_ot 
intended  hero’  to  imply  the  use  of  the  simplex  method  or  any  of  its 
derlvati ve.-;! ) . Mangasarian ' s results  in  thi.s  area  are  riol,  explicitly 
based  on  le.ast  element  argument.s,  but  rather  on  a key  lemma  having 
1,0  do  with  optimal  'iual  variables.  Our  primary  piu'pose  in  this  paper 
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is  to  dmonatral.e  that  Margasarian ' s theory  caa  be  interpreted  in 


terns  of  least  elements  of  polyhedral  sets.  I'^or  the  most  part,  our 
methods  are  matrix-theoretic.  In  the  ccurse  of  oui’  investigation, 
we  uncovered  a few  results  of  this  type;  they  are  included  here  because 
we  believe  tViem  to  be  new  and  of  Independent  interest. 

'llie  possibility  suggested  by  the  linear  progrsjnming  foniiulation 
of  a linear  complementarity  problem  raises  the  question  of  whetlier  this 
approach  can  be  recommended  in  practice.  Hence  our  secondary  pvirposc 
in  this  pe.per  is  to  give  at  least  a tentative  answer  by  reporting  the 
computational  experience  we  have  gathered  in  solving  some  linear 
programs--of  the  type  th.’.t  could  arise  from  linear  complementarity 
problems --by  an  iterative  (relaxation)  procedure  rather  than  by  the 
simplex  metnod  or  any  of  itf  variants.  Motivation  for  using  an 
iterative  method  can  be  found  in  the  size  and  structure  of  the  matrices 
one  might  expect  to  encounter  in  some  potential  applications  of  the 
linear  complementarity  problem. 

'Hie  plan  of  the  paper  is  the  following.  In  section  2,  \re  cover 
a bit  of  background  material.  Hie  section  has  two  parts.  The  first 
part,  fixes  our  notation  and  gives  some  characterizations  of  matrices 
in  terns  of  the  linear  complementarity  problem.  The  second  part  is 
a synopsis  of  the  main  results  Mangasarian  obtained  in  [l8J  and  [IS*]. 

In  section  3>  we  develop  our  least-element  interpretation  of  the  sub- 
,ject  and  present  some  incidental  matrix-theoretic  results.  In  the 
fourth  and  final  section,  we  discuss  our  somewhat  preliminary  com- 
putations.! experience  with  solving  linear  complementarity  problems  as 

linear  programs  by  relaxation  methods. 
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2. 1 Mlscellaneoua  preliminar.io:; 

n 

'I'hroughoul  thin  paper,  will  ficnote  ‘.ho  nonncg'j.!..!'. c orfchant 

n n m 

of  the  Euclidean  n-space  R and  R will  dcnoi.e  the-  vir-xsa  of 

real  n x m matrices.  W«  denote  the  i-th  colurm  (row'  u1  a matrix. 

A C R by  A (a.  ).  A real  matrix  A 0 R i f ' ar.id  ho  be  a 

!-';-i:iatrlx  (P-mahrl>: ) if  it  has  non-posLtivo  off  diagonal  entries  (positive 
princi.pal  minors).  We  shall  call  a matrix  A (■  " a K- matrix  (or  a 

Minkowski  matrix ) •’f  it  is  both  a P-  and  Z-matrdx  simultaneously.  The 
classes  of  all  rtxal  Z-,  P-  and  K-matriees  will  be  denoted  Iry  P and 
K rc.spGctively.  They  ai’e  treated  extensivf^ly  by  Kledler  y.nd  I'tak  fla]. 

For  a vector  q e r”  -and  a matrix  M C ”,  the  li.near 

c omplemon t ar  1 ty  problem,  denoted  by  (q,M)  is  that  of  firidini.^  x C r” 
such  that 

(2.1)  q -t  Mx  > 0,  X > 0 and  x'*  (n  + Mx)  0 . 

By  the  feas.lble  set  for  Vq,M)  we  mean  the  polyhedral  .set 

X(q,M)  fx  C R”:q  '•  Mx  >0,  x ()] 

We  say  that  the  problem  (q,t'i)  is  feasible  if  X(q, M)  is  iionemi)ty. 

A .subnet  3 of  k”  is  said  to  be  bounded  below  if  thej’e  is  a vector 
x'  t r”  such  that  x > x'  for  all  x C The  vectcu'  x C 3 is 

the  least  element  of  fj  if  x < x for  all  x P 3.  It  is  clear  that 
the  least  clement,  if  it  exists,  must  'nc  unique. 


1 1 ■w 


II. 


1 

I 


t : 

[ : 

I 


a^v^-a-ftvfcTjirj 


Minkowski  matrices  as  well  as  P-  and  '/.-matrices  play  very 
important  roles  in  ttie  linear  complementarity  problem.  it  ic  well- 
luiown  (see  Somelson  ^ al.  [25])  that  the  problem  (qjM)  has  a uivicpie 
.solution  for  every  q o.  if  and  only  if  M P.  Tarair  [Pf'j 
characterized  Z-matrices  in  the  following  v/ay. 

n ^ n 

Theorem.  Tlie  matrix  M £ R is  a '/.-matrix  if  and  only  if  for 

each  vector  q C for  which  the  feasible  set  X(q,M)  is  nonempty, 

there  exists  a least  element  x in  x(q,M)  satisfying  x'^  (q  + Mx)  - 0. 

Cottle  and  Veinott  [9]  proved  the  following  characterization 
of  K-matrices. 


n^  n 

idle  or  em.  T'ae  matrix  M £ R is  Minkowski  if  and  only  if  for  each 


",  the  feasible  set  X(q,M)  has  a least  element  x v/hich  is  the 


T 

only  vector  in  X(q,M)  satisiVing  x ' (q  + Mx)  - 0 


Note  that  the  characterizations  of  Z-  and  K-matrices  are  in 
tenns  of  least  elements  of  the  feasible  set  X(q,M).  This  feature  is 
of  fundamental  importance  in  the  present  work. 

Variovis  metliods  for  solving  the  linear  complementarity  problem 
(q,M)  in  the  important  special  case  where  M is  a /.-matrix  have 
been  considered  intensively  by  a number  of  a,uthors  [p],  [7],  [B]  , [llj, 
[2d],  [24].  Vdiile  Mangasarian' s proposal  [18],  [Ih]  to  solve  linear 
complementarity  problems  (q,M)  as  linear  programs  is  not  entirely 
new,  his  results  definitely  appear  to  enlarge  the  class  of  problems 


which  consist  of  primal  and  dual  feasibilities  and  the  reverse  of  the 
weak  duality  of  the  linear  program  (p.f).  Ihresumably,  the  computational 
advantage  offered  by  relaxation  methods  is  their  capacity  for  preserving 
matrix  sparsity. 


<•-  • ^ Mangasarian*  s results 

Our  purpose  here  is  to  summarize  the  principal  results  obtained 
by  Mangasarian  in  the  aforementioned  papers,  'llie  fi.uidai'nental  tlieorem 
is  the  following; 


Theorem  2.1.  Iiet  the  feasible  set  X(q,M)  be  nonempty,  ;and  let  M 


satisfy" 
(2 . b ) 
(2.0) 


MX  -•  Y 


'I'  T 

r X + s Y > 0 for  some 


) 


wliere  X,  Y t Z.  'inen  the  lineai  complementarity  probi.em  (q,M.' 

can  be  solved  by  solving  the  linear  program  (p>q,M)  with  p =•  r + M^: . 


ilie  proof  of  the  tlieorem  depends  heavily  on  the  key  lemma 


below. 
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Lennna  2.2.  Tf  x solves  the  lines, ,r  XJi'Ofcrfur,  .p.^.M)  ':,nd  there 


'!' , 


exists  an  opt.imal  solvition  y of  vq,p,-M‘)  sui-h  i.h:!.!,  y • p - M y .•  0, 
then  X solves  the  problem  (q,M). 


The  following  corollary  identifies  some  classes  oi'  matricei 
satisfying  conditions  (2.t)  and  (2.(.i)  in  Theorem  2-1. 


Corollary  I-et  the  feasible  set  Xiq,M)  be  noi'-'ii'.ipl.y  and  let 

e G be  any  positive  vector.  Then  for  each  of  the  cases  wncn 


(a) 

M - 

YX‘^,  X f 

i K,  Y G z 

(b) 

{ 

M = 

YX'^,  X e 

: Z,  Y G K 

i (c ) 

M G 

z 

(d) 

G z 

(p  = 


.T 


(p  - M e) 

(e)  -M  G K (p  = -e  or  p - M"e) 

(f)  € K (p  -■  -M'"e  or  p = e), 

the  linear  complementarity  problem  (q;M)  has  a solution  which  can  be 
obtained  by  solving  the  linear  program  (p,q,M)  with  the  indicated  p. 

The  results  above  are  drawn  from  the  first  of  the  two  pa[.ers. 
In  the  second  paper,  Mangasarian  extends  the  class  of  Ll'^-solvable 
linear  complementarity  problems  by  establishing  the  foLlov.dng  reaiark- 
able  theorem. 


Theorem  2,h.  Let  tl  feasible  set  X(q,M)  be  nonempty,  and  suppose 

X n 


there  exist  X,  Y i r"  ^ Ac  B,  H c 0 

and  p_  G rI"  such  that 
^0  + 


R 


, p G r; 


n 


1 


I 

I 

I 


in 








NfX  - Y t-  BG-,  Mil  > M;  X,  Y,  A G Y;  G,  H > 0 

X -if 

0 . 

-C  A_ 

'Llien  the  linear  complementarity  problem  (q,M)  has  a solution  which 
oaii  be  obtained  by  solviip/  the  lineal'  program  (p..q,M), 


Matrix  M of  (l) 

Cor.  ifions 
C'i  M 

Vector 
of  {,') 

Conditions  on  p 

L.  M ■-•  YX"^ 

X K,  Y •/. 

P 

T 

.)  o c,  p X > 0 

?.  M - YX"^ 

X C Z,  Y K 

T 

p - M s 

s > ('.  s'^Y  - 0 

5.  M 

M Z 

P 

p > 0 

1.  M 

m"‘  ‘^-:  z 

T 

p a M e 

e n 0 

‘,).  M = Y + ab^ 

Y ‘c  K,  a > 0, 

P - b 

ij  > Cj 

b > 0 

6.  M = i.'X  - Y 

X - Z,  Y '-.  K 

'Jt 

p » M 

I'o  '• 

X > Y 

(component. /rise) 

7.  M > 0 

( component'. - 
wise) 

ri 

T 

P rv  M e 

P'.  (1 ,1)  >■:  k” 

V J - 1 , . . . ; n 

M > 0 

( component- 
wise) 

n 

m.  , > T.  m. ., 
J=1  "■’ 

.Ifi 

Vi  - i,  . . . , n 

T 

u ■'•'  M r>Q 

Of,  > 0 

Pq(-M  1-  :.'dp.af5  Ml  > 0 

TAliLE  1 


3 . CONNECTION  WITH  LEAST  ELEMENTS 


In  this  sect; i;  we  develop  our  least  element  interpretation 
of  Mangasarian' s tho>,  rj  The  cornerstone  of  our  approach  is  a 
strengthening  of  Theorem  2.1.  The  new  result  (Theorem  5.9)  makes  it 
possible  to  invoke  the  theory  of  polyhedral  sets  with  least  elements. 
The  desired  relationship  between  the  two  theories  is  made  explicit  in 
Theorem  3.11.  Except  for  the  matrix-theoretic  results  mentioned 
earlier,  the  rest  of  the  section  is  concerned  with  showing'  how  Theorem 
2.U  and  the  special  cases  enumerated  in  Table  1 can  he  related  to 
Theorem  3.9  and  thereby  to  the  least  element  theory.  We  begin  by 
reviewing  a few  more  pertinent  facts. 


Definition  3.1.  Let  M be  a square  matrix. 


- T 

ment  of  M,  we  mean  a matrix  M = P MP  wiiere  P is  a permutation  matrix. 


The  following  facts  are  well-known  (see  e.g.  [4]): 

(i)  The  classes  of  Z-,  P-  and  K-matrices  are  invariant  under 
principal  rearrangements. 

(ii)  The  inverse  of  a P-matrix  is  a P~matrix. 


(iii)  The  property  of  a matrix  belonging  to  any  one  of  the  three  classes 
Z,  P and  K is  inherited  by  each  of  its  principal  submatrices. 

In  [lb],  Fiedler  and  Pt^  gave  a list  of  thirteen  equivalent  conditions 
for  a Z-matrix  to  be  a K-raatrix.  Here  we  quote  three  which  this  paper 
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Proposition  Let  A G Z.  Then  the  conditions  baiow  are  equivalent 

to  each  other- 

(iv)  there  exists  a vector  x > 0 such  that  Ax  > 0; 

(v)  the  inverse  A ^ exists  and  A ^ > 0; 

(vi)  the  principal  minors  of  A are  positive. 

Definition  j.3.  Let  A be  a nonsiiigular  principal  suhmatr''  . of  a square 
matrix  M,  Let  M be  a principal  rearrangement  of  M such  that 
M = jj) . Then  the  Schur  complement  of  A in  M,  deiioted  by 
(m/a),  is  the  matrix  D - CA~^. 

Properties  and  applications  of  she  Schu'  complements  have  been 
surveyed  in  Cottle  [5].  A proof  of  the  follovd.ng  proposition  can  be 
found  in  Crabtree  [10]. 

Proposition  j.4.  Let  A be  a nonsingular  principal  submatrix  of  the 
Minkowski  matrix  M.  Then  (M/A)  is  itself  a Minkowski  matrix. 

Definition  3.  The  matrix  A € ^ is  said  to  be  Leotitief  if  it 

has  exactly  one  positive  element  in  each  column  and  tliere  is  a vector 
■;  : r"'  such  that  x > 0 and  Ax  > 0 . 

Proposition  j.6.  Let  A h be  a Leontief  matrix.  Then  there 

exists  a submatrix  B t such  that  B is  itself  Leontief.  Further- 

more, B ^ exists  and  is  nonnegativc. 


A proof  of  the  preceding  proposition  is  given  In  Dantzlg  [12]. 

It  is  based  on  an  application  of  the  simplex  method  of  linear  programming. 

We  are  now  ready  to  present  our  results.  We  first  state  an 
alternative  proposition  which  is  an  immediate  consequence  of  the  well- 
known  theorem  of  Kuhn-Fourier  [15]  on  the  solvability  of  a system  of 
linear  relations. 


Proposition  5.7.  Let  X,  Y G Then  the  following  two  conditions 

are  equivalent  to  each  other: 


(3.1) 


r*^X  + s^Y  > 0 for  some  r,  s G 


and 


(3.1) 


Xu  < 0 
Yu  < 0 
u > 0 


> 4.  u = 0 . 


The  lemma  below  provides  necessary  and  sufficient  conditions  for  two 
Z-matrices  X and  Y to  satisfy  condition  (3.1). 


Lemma  3.8.  Let  X,  Y 6 be  Z-matrices,  Then  (3.1)  holds  if  and 

only  if  there  exist  a principal  rearrangement  with  permutation  matrix 
P and  a partitioning  of  X and  Y such  that 


(3.2) 


T 

P XP 


/ X 

X ] 

f Y,, 

Y \ 

11 

12  1 

T 

11 

12 

\ ^21  ^22 j 

, P YP  = 

1 Y y 

) 21  22 

(5.3) 


^11  ^12 


Y y 

21  ?-2l 


S K 


L? 


-i 


■4 


Proof; 


'Sufficiency".  We  shaii  show  that  condition  (:).  1)' holds.  Let 


u satisfy  Xu  <0,  Yu  < 0 


which  implien  u < 0 (atnl 


and  u > 0.  We  then  Imve 


^11 

X j p 

n < 0 

^.1 

' 

thus 

u “ O)  because 

l\l 

\2\ 

-1 

1 

> 0 . 

\h.l 

"Necessity".  Condition  (.d.l)  can  be  rev;ri.tten  a.s 
(3.'0  (x^',  y'^')  il)  > 0 with  (^)  > 0 . 

The  matrix  A - (x'^j  Y^)  € ^ ^ has  at  most  one  positive  element  in 

ouch  column.  We  may  assume,  without  lo.cs  of  generality,  that  it  has 

exactly  one  in  each  coliuiin;  otherwise  we  can  always  delete  those 

columns  of  A con.sisting  entirely  of  nun-po.s I tive  entries  and  delete 

at  the  same  time  the  corresponding  compoiiontii  oi  the  vector  (r  ,s  ) , 

tlusn  we  are  i.eft  with  a smaller  system  satisfying;  in  which  the 

matrix  has  exactly  one  positive  element  in  each  co'J.umn  and  we  can  work 

with  this  smaller  matrix.  Now  the  matrix  A is  Leontief;  hence  by 

Proposition  J.6,  there  exist.s  a submatrix  B € ^ ^ such  that  B is 

itself  Leontief.  b”^'  exists  and  is  nonnegative.  Note  that  the  same 
T T 

column  of  X and  Y cannot  both  simultaneously  appear  in  B 
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Proof;  We  firat  note  that  if  P ia  a permutation  matrix,  then  (5.5) 
holds  if  and  only  if  (p'*'MP)  (p'^’XP)  - P^YP.  Therefore  (5.5)  holds  if 
and  only  if  it  holds, for  every  principal  rearrangement  of  M,  X and  Y. 
Now,  the  sufficiency  port  of  the  theorem  follows  immediately  from  Leituna 
5.8  end  the  observation  above.  For  the  necessity  part,  it  remains  to 
verify  condition  (5.B).  Condition  (5.9)  implies  that  X.^^^  is  nonsingular. 
Solving  for  in  the  equation 


we  obtain 


Hence 


'21 


^21 


^21^11  " ^22^21  • 


= (Y, 


21  22  21'  11  • 


^22  “ ^21^12  ^22^22 


or. 


= (In  - . 


i 


i 


Note  that  the  matrix  on  the  left  side  is  ,j\ist  the  Schur  complement  of 


Y^,g  in  the  Minkowski  matrix 


^11  \2 
\"^21  V 


By  Proposition  5>^>  it  is  nonsingular.  Therefore  so  is  the  matrix 

X^^,  - X„-XT?TC.„.  Now  (5.8)  follows  from  Schur' s det.?rminental  formula  (51 

C.r.  c.  I.  -LI  Ltr. 
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X . 

X, 

11 

1<? 

X , 

X 

?.l 

22 

- det  X^.,  det(X,„,,  - 


This  completes  the  proof  of  the  theorem. 


Notation.  Let  c denote  the  class  of  square  matrices  satisfying 
conditions  (5.5)  and  (5.6). 

It  is  clear  that,  using  Theorem  5.9,.  we  can  readily  ccnstruct 
matrices  belonging  to  the  class  C starting  with  any  Minkowski  matrix. 
In  the  sequel,  we  shall  focus  our  discussion  on  this  class  o . Our 
purpose  is  to  establish  a relationship  between  the  class  of  linear 
complementarity  problems  (q>M)  with  M k'.  C and  the  theoi'y  of  poly- 
hedral sets  having  Itast  elements.  In  order  to  achieve  this,  we  state 
and  prove  the  following  lemma. 


Lemma  5.10.  Let  X,  Y '5  be  7, -matrices  and  let  (s,q)  d x 

Suppose  that  the  polvhedral  set 

V ==  [v  d:  R'^;q  + Yv  > 0,  s + Xv  > 0] 

is  nonempty  and  bounded  below.  Then  there  exists  a least  element  v . V 

T 

satisfying  (g  + Yv)  (s  Xv)  - 0,  Furthermore  this  least  element  can 
be  obtained  by  .solving  the  linear  program 


(5.10) 


minimize  r v subject  to  q + Yv  > 0,  s -i-  Xv  > 0 


for  any  positive  vector  r T R*' 


•I',  ■ ■'/'  •'i-H*'  . ' • 


Proof;  Consider  tlie  linear  program  (5.10)  where  r S is  positive. 


Since  the  constraint  set  V is  bounded  below  and  obviously  closed, 
problem  (3. 10)  has  a solution,  say  v.  We  want  to  prove  that  v Is 
the  least  element  of  V.  (This  will  imply  that  v solves  the  linear 
program  (3.10)  for  any  other  choices  of  the  positive  vector  r. ) 

So  let  V € V and  v'  « (vp  be  the  vector  with  vj^  - min(v^,v^) 
for  each  i.  Consider  index  k.  We  may  assume,  witnout  loss  of 
generality,  that  v'  ” v.  . Then  we  have 


(q  -*•  Yv')u  = + Y,, 


'k  ■'k  kf  £ kk  k 


q.  + E Y,  ,v.  + Y. , V. 
^k  ki  & kk  k 

I ?^k 


> 0 . 


Similarly,  we  can  deduce  (s  + Xv' )j^  >0.  These  inequalities  hold  for 
k ~~  1,  ...,n.  Therefore  v'  (i  V.  By  the  definition  of  v,  it  follows 
that 

T-  T T- 

r V < r v'  < r v . 


Hence  v -■  v'  < v.  Tills  shows  that  v is  indeed  the  least  ele’^ent  of 
V.  It  remains  to  verify  that  v satisfies  the  complementarity 


property . 

Clearly  we  have 

(q  + Yv) ^ (s  + 

Xv)  > 0 because  v 

G V. 

Suppose  (c 

1 + Yv) j > 0 and 

(s  + Xv)  > 0 

for  some  index  i. 

Let 

r > 0 and 

consider  the  vector  v = v - ce^ 

where  e'^  is  bhe 

i-th 

unit  vector.  We  have 
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xvitsil  Vii-Lhj  lij  <k  ». 


Therefore 


and 


(q  + Yv)j  > 0 for  every  ,j  / i , 
(q  + Yv)^  = q^  + (Yv)^  - cY^^  . 


Similarly,  we  have 


and, 


(s  > 0 for  every  ,]  ^ i 

(s  + Xv)^  = (s  + Xv)j^  - tXj^^  . 


Clearly,  Y^^ 
If  Y.,^  > 0 

0 


< 0 (X,^^  < 0)  implies  (q  + Yv)^  >0  ((s  + Xv)^  > 0). 

and  X^^  > 0,  then  choose  e > 0 such  that 

< c;  < min((q  + Yv)^/Y^^,  (s  + . 


With  this  choice  of  t,  we  sen  that  (q  + Yv) ^ > 0 and  (s  + Xv)^  > 0. 

T T- 

Hence  it  follows  that  v € V.  But  r v < r v,  contradicting  the  fact 
that  V solves  (5.10). 


M t 0 . Then  the  inequalities 
X > 0 

X - Xv,  the  inequalities 

(5.11)  (y)v  > (.q)  • 

IB 


Consider  the  problem  (q,M)  with 
q + YX'^x  > 0 , 

define  the  feasible  set  for  (q,M).  With 
above  can  be  expressed  in  the  form 


1 


tT.7RW.T^..rr»TOW».^^ 


Let  V be  the  set  of  all  solutions  of  (3.11).  Then  it  is  clear  that 
(q,M)  is  feasible  if  and  only  if  V ^ 5*'*  Partitioning  the  vector 


q = 


'll' 


\ 


according  to  Theorem  3.9>  we  see  that 


V c V implies  that 


X,, 

1 0 \ 

11 

12  \ 

V > 

1 

^ ^21 

^22  1 

i -qp  1 

i 

■I 


Since  the  matrix 


11 

"l2 

21 

^22 

is  Minkowski  by  condition  (3.9)  of  Theorem  3.9;  its  inverse  is  non- 
negative  by  Proposition  3.2.  Therefore  we  have 

/^ll  ^2'”^ 

V c V implies  v > 


21 


'^po , 


i.e.,  the  set  V is  bounded  below.  Hence  if  V ■/  it  follov/s 
from  Lemma  5.10  that  V has  a least  element  satisfying 
(q  + Yv)  (Xv)  - 0 and  v can  be  obtained  b'-  k~..  ;i..g  the  linear 
program 

T 

minimize  r v subject  to  q + Yv  > 0,  Xv  > 0 
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for  any  posit.ive  vector  r C Lettinjj  ic  - Xv,  we  see  that  x 

is  a solution  of  (q,M)  and  it  can  he  obtained  by  solving  the  linear 
prograJti 


(5.12)  minimize  (X'*^r)^x  subject  to  q + Mx  > 0,  x > 0 

which  is  just  (X  r,  q,  M) . Suimning  this  up,  ve  have  proved 

Theorem  5.11.  Let  M G and  suppose  that  the  pr<)blem  is 

feasible.  Then  there  exists  a bijective,  linear  map  ->  such 

that  the  feasible  set  X(q,:i)  is  mapped  onto  a polyhedral  set  V 
having  a least  element  v whose  pre-image  x = L*'^(v)  solves  the 
problem  (q,M). 

It  is  this  theorem  v^ich  provides  the  desired  relationship  between 
the  linear  complementarity  problems  with  matrices  in  class  C and  the 
theory  of  polyhedral  sets  having  least  elements.  Together  with  Lemma 
5.10,  the  theorem  also  provides  an  interpretation  for  the  conditions 
imposed  on  the  vector  p chosen  in  the  objective  function  of  the 
corresponding  linear  programs. 

Remark  1.  When  using  the  linear  program  (5.12)  to  obtain  a solution  to 

the  linear  complementarity  problem  (q,M),  one  must,  first  of  all, 

T,  T T 

solve  the  system  of  linear  equations  p A - r where  r > 0 is 
chosen  arbitrarily,  to  get  the  vector  p u'.ed  in  the  objective  function 
of  the  linear  program.  For  large  n,  this  problem  of  finding  p is  not 
an  insignificant  task. 


iSilWiftraliirlrh’iiiiiii  r 


Remark  2,  For  MG  C,  Mangasarian  shows  in  Theorem  Gj4  that  the 
problem  (q,M)  can  be  solved  via  the  linear  program  (p,q,M)  for 
any  p belonging  to  the  class 

. . 

p ^ = {p  £ R^  sp"^  = r'^  + s^M  for  some  (r,  s)>0  such  that  r'^X  + s'^Y  > 0 ) . 

Our  least  o‘'ement  argument  above  shows  that  such  a vector  p con  be 
chosen  arbitrarily  in  the  class 

- (p  G r'^jP^  = r'^X”^  for  some  r > 0)  . 


Here  we  demonstrate  that  p^  Note  that 


m m m m T 1 

p t=  + s^M  = (r  X + s y)X  ^ 


for  some  r,  s > 0 and  r X + s Y > 0,  Hence  it  suffices  to  show  that 

for  any  t £ R^,  t > 0,  there  exist  r,  s > 0 such  that 
T T r 

(X  ,Y  )(  ) = t.  We  mentioned  in  the  proof  of  Lemma  5.B  that  we  may 
s 

T T 

assume  without  loss  of  generality  that  the  matrix  (X  ,Y  ) is  Leontief. 


We  also  showed  that  there  exists  a complementary  submatrix  B of 

T T “1 

(X  ,Y  ) which  has  a nonnegativo  inverse.  Clearly,  B t > 0.  Now  we 

T T 

define  the  vector  (r  ,s  ’>  us  follows; 


If  B 1 = (T*),j 
otherwise  , 

T T 

for  each  i = 1, Then  it  can  readily  be  verified  that  (r  ,s  ) 
is  the  desired  vector. 

Re.fiark  The  proof  of  Tu-^orem  3.11  shows  that  condition  (3.6)  implies 
that  the  polyhedral  set  V is  bounded  below.  The  converse  is  also 
tnie  and  is  an  immediate  consequence  of  the  duality  theorem  of  linear 
programming. 


I Remark  4.  For  M C C a.nd  q the  solution  x of  the  problem 

' ■ 

t 

(q>M)  obtained  in  Theorem  3.11  need  not  be  the  least  element  of  the 

y!' 

I feasible  set  X(q, M)  under  the  usual  ordering  of  as  the  follow- 

ing  example  shows.  However,  it  vdll  be  demonstrated  In  Pang  |:'Pj 

I 

that  X is  always  the  least  element  under  the  partial  ordering  induced 

i 

I by  the  polyhedral  cone 


k. 


' > iyf>  jsna ; '*T'V?T«w^*‘r 


Having  established  the  desired  relationship  mentioned  above, 
we  proceed  to  investigate  the  classes  of  matrices  introduced  by 
Mangasarian.  It  is  clear  that  all  the  classes  of  matrices  in 
Corollary  2.3  are  subclasses  of  c • 

In  [19]>  Mangasariein  introduced  the  "slack  linear  complementarity 
problem"  of  finding  x,  y o such  that 


(3.13] 

and 


0 = (o>  to  ?)  £ ° 


T T 
u X = V y = 0 


in  order  to  extend  the  class  of  LP-solvable  linear  complementarity 

T / 

problems.  It  is  clear  that  if  A satisfies  the  condition  that  x Ax  / 0 
for  all  0 X > 0,  and  if  (3.15)  has  a solution  (x,y),  it  necessarily 
follows  that  y - 0,  So  x solves  (q,M).  Mangasarian  then  shows  that 
if  M satisfies  conditions  (2.7)  and  (2.8),  the  matrix  j]  satisfies 
conditions  (2.5)  and  (2.6).  He  then  invokes  Theorem  2.1  and  the  above 
observation  to  obtain  Theorem  2.4. 

Here  we  intend  to  derive  Theorem  2.4  using  a different  approach. 
We  want  to  employ  the  abi  ve  established  relationship . Our  eventual 
aim  is  to  show  that  a matrix  satisfying  conditions  (2.7)  and  (2.8) 
belongs  to  the  class  c . 

It  has  long  beer,  an  open  problem  in  the  theory  of  linear  com- 
plementarity problems  to  characterize  the  class  K of  matrices  for 
which  the  feasibility  of  the  linear  complementarity  problems  implies 
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their  solvability.  Although  this  class  K is  still  a mystery,  various 
subclasses  have  been  explored  and  studied  intensively.  (See  e.g. 

Lemke  [I?].)  Theorem  3.11  shows  that  the  class  C is  a subclass  of  K. 

The  following  example  shows  that  it  is  a proper  subclass  of  k • 

1 1 

Example . Let  M = ^).  Then  it  can  easily  be  shown  that  the  problem 

(q,M)  always  has  a solution  for  every  q •'£  R . We  claim  that  M C . 

2X2 

Suppose  not,  then  there  exist  X,  Y,  c R , both  Z-matrices  satisfying 
conditions  (3.5)  and  (3.6).  We  have 


/ 1 1 ) 

1 

f=‘ll  =‘l2 1 

f ^11  ^12  \ 

1 — 1 
I — 1 

i=‘21  ='22) 

i ^21  ^22  / 

which  implies 


and 


^11  ^21  “ ^11 


^11  ^21  ""  ^21  ‘ 


Thus  y^^  = y^^  < 0,  Similarly,  y^^  = y^^^  < 0.  Lemma  3.B  would  then 
imply  X G K.  In  particular,  det  X =-  ^ However, 


and 


° ■'u  “ ^21  - ='21  ^ ■='23 


° < *22  " ^22  ■ =‘12  S -=‘12  • 


Therefore,  ^11^22  ~ ^12^21  contradiction.  This  proves  that 

VI  C-  . 
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Proof  I Since  Y (£  K and  a > 0,  it  follows  that  a s y"^a  >0.  We 
way  write  M = Y(I  + ab*^).  Let  X -=  (I  + ab*^)"^.  Then  M = YX“^. 
It  remains  to  show  that  X e K.  An  easy  calculation  shows  that 


r ••  T 

X I ab^  S Z. 

1 + b a 


-1  - T 

It  follows  from  Proposition  3.12  that  X = I + ab  £ Pj  hence 
X Z P by  fact  (ii)  mentioned  earlier.  Therefore  X £ K.  This  completes 
the  proof. 

Corollary  3.1^.  If  M - Y + ib*^  where  Y £ K and  a,  b > 0,  then 

M e C. 


Thus  we  have  shown  that  the  class  of  matrices 


{M  £ = Y + ab'’^,  Y £ K and  a,  b £ rJJ) 


is  a subclass  of  0. . Furthermore,  the  matrices  X and  Y in  the 
factorization  M = YX”^  are  Minkowski. 

Remark.  In  [19],  Mangasarian  treated  the  above  class  of  matrices  with 
the  assumption  that  the  vector  b is  strictly  positive.  Here,  we  have 
relaxed  this  assumption  slightly  and  merely  required  b to  be  nonnegati^■e. 


We  next  proceed  to  another  class.  The  proof  of  the  following 
lemma  can  be  found  in  Fiedler  and  Pt4k  [1^]. 
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Lemma  3» I^.  Let  A G Z,  B G K and  A > B,  then 
(vii)  A G K 

(vili)  A”^  G K,  BA"^  e K 
(ix)  A"^  < I,  BA“^  < I . 

Lemma  ?.l6.  Let  AGZ,  BGK,  I>B  and  A > B.  Then  the  matrix 
I + A - B G P. 

Proof;  The  hypothesis  are  inherited  by  principal  submatrices,  hence  It 
suffices  to  show  det(l  + A - B)  > 0.  Let  C <=  A - B > 0.  Then 
B - A - C belongs  to  K by  assumption.  We  have 

(I  + C)(A  - C)  = A - C + CB  = A - C(I  - B)  < A . 

Hence  (I  + C) (A  - C)  G Z.  Since  I + C > I and  A - C £ K,  it 
follows  readily  from  condition  (iv)  in  Proposition  5.2  that 
(l  + C)(A  - C)  G K.  Hence 

det(l  + A - B)  = det(l  + C] 

= det(H-  C)(A  - C)/det(A  - C)  > 0 . 


This  completes  the  proof.  | 

Lemma  5.17.  Let  Z^,  Z^,  Z^  G Z.  Z^  and  Z^  : K.  Then  !j 

the  matrix  Z^^  + Z,,  - Z^  G P.  J 


Proof;  Again,  it  suffices  to  show  det(Z.j^  + Z^  - Z^)  > 0.  We  write 


Lemma  5. IS  implies  ttie  assumptions  of  Lemma  3.16  are  satisfied  with 
A “ ® ~ Therefore  det(l  + ^ 

Lemma  3.15  also  implies  that  det  > 0.  Hence  det(Z^^  + - Z^)  > 0. 

Corollary  3.18.  Let  A >r  Z,  B c K and  A > B,  Tlien  the  matrix 
2A  - B e P. 

Remark.  As  a matter  of  fact,  following  the  proof  of  Lemma  3.17^  we  may 
deduce  that  if  A,  B satisfy  the  assumptions  in  Corollary  3.18,  then 
the  matrix  XA  - B C P for  all  X > P. 

Corollary  3.19.  If  A G Z,  B G K and  A > B,  then  det(2A  - B)  > det  B. 


Proof;  According  to  Theorem  1 of  Ostrowski  [PI],  If  Y £ Z has 
positive  diagonals  and  M is  a matrix  such  that  ^ ®Jid 

|m^jl  < -y^j  for  all  i 7^  then  |det  Mj  > det  Y.  So  choosing 
Y = B,  M - PA  - B,  we  have  |det  m|  = det  M and 

> and  0 > 2a^^  > Pb^^  for  all  i j.  Hence  -b^^  > Pa^^  -b^^ 

> b^j,  i.e.,  |2a^^  - b^j]  < Osti’owski's  theorem  applies  and 

the  proof  is  complete. 
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' '"il 

if 

d - ^ 

'"id 

if 

j and  <0 

1 0 

if 

d i and  ra.  j > 0 . 

^ iJ 

Let  B = 2A  - Mj 

clearly. 

M = 

2h  - B and  A > B.  We 

obviously  have 

A € Z,  thus  B G 

Z.  It  remains  to  show  that  B d K, 

If  B . 

then  by  its  definition. 

' '"ii 

if 

d - i 

'■id  - < 

'"id 

if 

d / 1,  < 0 

^ "'"id 

if 

d / i,  > 0 , 

so  that  letting 

e'^  = (1, 

, 1)  € R*^,  we  have  for 

i ~ 1,  ...  , n 

(Be! 


n 

r,  b 


= m^i  + 


n 

.1-1 


m.  . -4' 

i.1 


n 

z 

J=1 

>0 


(-m^j) 


Thus,  Be  > 0 if  condition  (5.1^4)  ic  satisfied.  Similarly,  we  may 

deduce  that  B e >0  if  condition  (5.15)  is  satisfied.  Therefore,  in 
either  case,  it  follows  that  B t K.  This  completes  the  proof. 


Remark  1.  The  proof  above  and  Lemma  5.20  show  that  a matrix  .satisfying 
conditions  (5.1^)  and  (5.15)  belongs  to  the  class  P. 
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Remarlt  2.  In  [19],  Mangasarian  treated  the  classes  of  matrices  M 
satisfying  conditions  (3.14)  and  (3.13)  with  the  additional  assun^tion 
that  M is  nonnegative.  The  corollary  above  enlarges  these  classes  by 
omitting  the  nonnegativity  assumption  and  shows  that  the  corresponding 
linear  complementarity  problems  are  still  related  to  polyhedral  sets 
with  least  elements. 


Up  to  this  point,  we  have  shown  that  all  matrices  in  Mangas ar Ian * s 
Table  1 belong  to  the  class  C . Furthermore,  we  have  established  that 
the  last  four  subclasses  belong  to  P,  thus  to  the  class  K mentioned 
earlier.  Therefore  they  do  not  extend  our  knowledge  about  the 
class  X, 

Remark.  If  M belongs  to  any  of  these  four  subclasses,  the  problem 
(q,M)  has  a solution  for  every  q € R becaufe  M must  necessarily 
be  a P-matrix.  Thus  the  feasibility  assumption  can  be  removed. 

As  all  matrices  in  Table  1 are  obtained  by  specializing  the 
conditions  (2,7)  and  (2,8)  in  Theorem  2.4,  it  is  natural  to  ask  whether 
a matrix  satisfying  these  two  conditions  alone  belongs  to  C . We  answer 
this  question  by  establishing  the  following  theorem  which  summarizes 
some  of  the  previous  results. 

Theorem  3.23.  Let  M € Suppose  there  exist  X,  Y 2 

A 2 r“  B,  H 2 R^  ^ G t R*"  ^ p rJ  and  Pq  2 R®  satisfying 

(3.16)  MX  = Y + BG;  MH  > BGj  X,  Y,  A 2 Z;  end  G,  H > 0; 
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Then 

(3.18)  M has  the  representation 

M «= 


where 

Y y - HA"^G,  }C  - X - HA"^G,  and  fl  ? MH  - BA  ; 


(3.19)  furthermore,  Y G Z and  X € K. 


X ••H 

Proof;  The  matrix  [ belongs  to  class  Z,  thus  condition 
(3.17)  implies  that  it  belongs  to  K.  In  particular  A"^  exists. 
We  have 

? = Y - flA“^G  « Y - (MH  - BA)A"^G 


= Y + BG  - M(HA"^G) 

= M(X  - HA'^G)  = MX  . 

The  matrix  X X - IIA  ^G  is  the  Schur  complement  of  A in  the 
Minkowski  matrix  [ ^],  hence  X is  itself  Minkowski  by  Proposition 

J).k  and  in  particular,  nonsingular.  Thus  M = XX”^,  establishing  (3.18). 
It  remains  to  verify  that  5 t:  Z.  We  have  Y Y - flA'^'G  where 


Corollary  3.24.  Suppose  M c;  satisfies  conditions  (3.16)  and 

(3.17).  Then  M6  0. 

---1 

Remark.  In  the  factorization  M - YX  above,  the  matrix 

- - -1  - 

Y K y - HA  G contains  the  matrix  fl  which  is  defined  in  terms  of 

M,  i.e.  the  factorization  involves  M itself  implicitly.  This  some- 
what avrkward  situation  can  be  remedied  by  .solving  for  M using  con- 
dition (3.16)  to  obtain  M = (Y  + BG)X”^.  Substituting  into  the 
definition  of  fi,  we  see  that  M is  no  longer  involved  in  the  factors. 
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it.  COMPUTATIONAL  EXPERIENCE 


Methods  for  solving  linear  complementarity  problems  for  various 
classes  of  matrices  have  been  proposed  and  investigated  intensively. 

Among  these  are  the  principal  pivotlrig  motViodliiJ,  i 3 ] anil  Lemke's  almost 
complementarity  pivoting  algorithm  (6],  (l6l.  These  methods  (and  some 
others)  work  rather  satisfactorily  for  matrices  of  reasonable  oixe. 

But  in  many  applications  of  the  linear  complementarity  problems  to  partial 
differential  equations,  the  matrices  are  often  large,  sparse  and 
specially  structured.  See  [PlJ  for  example.  Methods  like  those 
mentioned  above  seem  to  be  inefficient  when  applied  to  ths'se  problems. 

For  one  thing,  most  of  the  nice  propert.ies  (especially  the  sparsity 
which  is  a very  important  factor  for  efficiency)  that  the  matrices 
originally  possess  will  be  destroyed  when  the  problems  are  being  pro- 
cessed. Recognizing  this  disadvantage,  one  would  like  to  use  iterative 
(relaxation)  procedures  which,  presumably,  have  the  computational 
advantage  of  preserving  matrix  sparsity. 

In  1. iB],  Mangasarian  proposed  formulating  linear  complementarity 
problems  as  linear  programs  and  solving  them  by  applying  relaxation 
methods  to  the  linear  inequality  system  (:,’.l-i).  In  this  .section,  we 
discuss  our  somewhat  preliminary  computational  experience  using  this 
solution  strategy  and  attempt  to  answer  the  question  of  whether  this 
approach  can  be  recc  mended  in  practice. 

For  the  sake  rf  clarity,  we  first  review  part  of  the  theory  of 
relaxation  methods  for  solving  linear  inequality  .systems  [1],  [2], 

[13],  [20]. 
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We  want  to  find  a vector  z : satisfying  the  system  of 

linear  incqviaiities:  Az  < h where  A o r"' arid  b ; r”'.  Let  k^. 

be  the  i-th  row  of  the  matrix  A.  The  relaxation  method  (due  to 

Ic 

Eremin  11511  oonstr-ucts  a sequence  {2  ) in  the  following  manner; 

(i)  Choose  'P  arbiti-arily.  Let  k 0. 

k 

(.ii'l  If  A2  ^ b,  the  procedure  terminates. 

If  not,  then  some  linear  inequality  is  violated.  Let  i be 
the  smallest  index  of  the  most  violated  con.straints ; 

A.z^  - b,  = max  (A  7,^  “ • 

^ 1 j < n 'J  ■' 


(iii)  Define 

(IM) 


k+1 


- K 


kiV 


- b. 


W\t 


Theorem  (Eremin  [15]). 

The  sequence  difined  by  the  relaxation  method  under 

the  assumptions 

(i)  p c (o,Pl,  k - i,y, .. . 

(ii)  inf  > 0 . 

converges  to  one  of  the  solutions  of  the  linear  inequality  system 
A?,  < b if  the  latter  is  consistent. 


We  now  apply  the  method  to  solve  the  linear  program  (p,q,M),  or 
equivalently,  to  find  vectors  x,  y ■-  r”  such  that  the  following  system 
of  linear  inequalities  is  satisfied. 
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Remark . The  vectoro  x and  y are  prunal  and  dual  variables, 
respectively. 

We  now  present  an  algorithm  based  on  the  relaxation  method  for 
solving  (4.2).  Let  c.  > 0 be  some  preassigned  positive  tolerance. 

The  algorithm  starts  by  choosing 

o\ 


arbitrarily.  Initially  i = 0. 


Step  1.  Let  z 


and  define 


n 


(4.3)  d(z'^)  ~ nox(  max  (-  Z m,  .x'.-q,'), 

KKn  0=^1 


meix  ( -X 
KKn 


max  ( Z tm  .y'  - p.), 
c ,j  < n k=-l  ^ ^ 

\),  max  (-y^:),  Z p.x^  + Z q^y;J)  . 
l<0<n  ^ i=l  ^ ^ 0=1  ■ 


I- 


?>py  ••  •Tyririy7^f^rf|r;»»r^  .•» 


Step  2,  If  d(z  ) < e,  stop. 


Otherwise,  construct  z = 


according  to  (4.1)  and 


. return  to  step  1 with  i+1  replacing  Sl. 


The  main  work  involved  in  each  iteration  cycle  of  the  algorithm 

is  the  computation  of  the  quantity  d(z^)  and  the  updating  of  the  new 

iterates.  When  actually  progreimmed,  d(z'^)  is  computed  as  in  (4.3). 

i+1 

While  in  constructing  the  new  approximate  solution  z , an  index  is 

set  to  check  where  the  maximi  ing  term  comes  from,  in  order  to  avoid 

computing  the  same  components  repeatedly.  For  instance,  if  the 

maximizing  term  is  in  { - ®i  j “ *^i^  i-l'  then  the  vector  y 

need  not  be  updated;  on  the  other  hand,  if  the  maximizing  terra  comes 

from  component  of  x will  be  changed  while 

0 

the  other  components  of  z will  remain  unchanged  in  the  next  Iteration. 
These  features  of  the  system  are  important  in  reducing  the  computational 
effort  of  the  algorithm. 

There  is  a variation  of  the  algorithm  that  one  might  want  to 
consider  when  actually  coding  it.  In  (4.2)  where  the  new  iterate  z 
is  computed,  it  is  necessary  oo  divide  by  the  2-norm  of  the  gradient 
of  the  most  violated  constraint.  If  the  number  of  iterations  is  large 
compared  to  4n+l  which  is  the  number  of  constraints  in  (4.1),  it 
would  be  more  economical  to  reduce  these  divisions  if  tJssible.  A way 


to  achieve  this  is  to  work  with  the  "normalized  system"  which  is  obtained 
from  (4.1)  by  normalizing  each  constraint  separately.  The  division 


steps  in  (4.2)  are  than  no  longer  needed.  An  obvious  disadvantage  of 
this  "normalized  system"  is  the  need  for  more  storage  space  for  the  whole 
matrix  and  also  for  the  constant  vectors.  But  if  the  problem  itself 
weru  of  moderate  size  so  that  no  storage  problem  would  occur,  tnen  one 
might  try  to  use  this  "normalized  system"  instead  of  the  original 
system  (4.1). 

We  performed  several  experiments  to  solve  the  problem  (q,M) 
where  q £ R^'  was  randomly  chosen  and 


We  chose  p - (1,  . . . , 1)  € R . The  relaxation  parameters  (X  ) 
were  chosen  to  be  the  same  in  each  iteration.  The  tolerance  e was 
generously  chosen  to  be  10  The  algorithm  was  then  applied  to  the 
inequality  system  (4.1).  All  the  computation  was  done  on  the  IBM  370/l68 
using  FORTRAN  H with  Opt  = 2.  The  results  are  summarized  in  the  follow- 
ing tables. 
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Inputs:  n ~ 5.  = (2,  -1,  -4,  6,  -5); 

starting  iterate  x*^  = =0;  original  system. 

Solution  of  (q,M);  = (O,  2,  5,  0,  2.5). 


Value  of  A 

No.  of  Iterations 

Execution  '.ime  (sec) 

.7 

1757 

.58 

.8 

1580 

.50 

.9 

1108 

.45 

1.1 

i49 

.58 

1.2 

649 

.37 

1.5 

505 

.35 

1.4 

452 

.53 

1.5 

558 

.31 

1.6 

176 

.27 

1.7 

949 

.42 

1.8 

668 

.37 

TABLE  2 


Ul 


Inputs 


n 5.  = (2,  -1,  -4,  6,  -5) 

starting  Iterate  --0;  normalized  system. 

Solution  of  (q,M):  = (O,  2,  0,  2.5) 


Value  of  X 

No.  of  Iterations 

Execution  time  (sec) 

1.0 

669 

..58 

1.5 

150 

.28 

1.6 

887 

.41 

1.8 

965 

.43 

TABLE  5 


k2 
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Inputs; 


n = 5.  q = (2,  -1,  -^,  4,  -5); 

starting  Iterate;  jP  =:  (5,  J,  J, 

0 T 

y « (5,  . . . , 2)  ; *^oi'raalized  system. 


Solution  of  (q,M);  k ^ {O,  2,  J>,  1,  5) 


Value  of  ?v 

No.  of  Iterations 

Execution  time  (sec) 

.8 

17364 

3.12 

.9 

14263 

2.65 

1.0 

11664 

2.19  ; 

1,1 

9663 

1.88 

1.2 

7926 

1.57  ,: 

1.5 

6571 

1.56  ;j 

1.4 

5626 

1.19  1 

1.5 

4381 

1.21  1 

1.6 

5552 

.81  ^ 

1.7 

2555 

.65 

1.8 

1490 

.50  j 

1.9 

664 

>, 
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TABLE  4 
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Inputs; 


ri  = 7.  = (2,  -1,  -4,  6,  -5,  3,  -2) 

starting  iterate  =0;  original  system 


Solution  of  problem  (q,M);  x^  <=^  (O,  2,  3,  0,  2.73,  .5,  1.25) 


Value  of  X 


No.  of  iterar.ions 


Execution  time  (sec) 


TABLE  5 


20000  is  the  maximum  number  of  iterations  that  we  allow. 
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